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Abstract — We present a method to compute, quickly and 
efficiently, the mutual information achieved by an IID (in- 
dependent identically distributed) complex Gaussian input 
on a block Rayleigh-faded channel without side informa- 
tion at the receiver. The method accommodates both scalar 
and MIMO (multiple-input multiple-output) settings. Oper- 
ationally, the mutual information thus computed represents 
the highest spectral efficiency that can be attained using 
standard Gaussian codebooks. Examples are provided that 
illustrate the loss in spectral efficiency caused by fast fading 
and how that loss is amplified by the use of multiple transmit 
antennas. These examples are further enriched by compar- 
isons with the channel capacity under perfect channel-state 
information at the receiver, and with the spectral efficiency 
attained by pilot-based transmission. 

I. Introduction 

IID (independent identically distributed) complex 
Gaussian inputs are most relevant in wireless commu- 
nication impaired by Gaussian noise. Some of the argu- 
ments for this relevance are that, if perfect CSI (channel 
state information) is available at the receiver, then: 

• These are the unique capacity-achieving inputs. 

• Their mutual information represents very well the 
mutual information of proper complex discrete con- 
stellations (e.g., QAM) commonly used in wireless 
systems. (This holds up to some power level that 
depends on the cardinality of the constellation |[l].) 

Expressions for the perfect-CSI capacity achieved by IID 
complex Gaussian inputs are available (cf. Section IV I 
and thus such capacity can be easily evaluated. 

Remove now the perfect CSI. No expressions are avail- 
able for the mutual information achieved by IID complex 
Gaussian inputs save for the special case of memory- 
less channels Q. Moreover, straight Monte-Carlo com- 
putation is not feasible because it would entail large- 
dimensional histograms. Only asymptotic expansions of 
the mutual information in the low- and high-power 
regimes fS^-f^l have been derived. And yet, although no 
longer capacity-achieving [7|, |8|, IID complex Gaussian 
inputs remain highly relevant. Operationally, the mutual 
information they achieve represents the highest spectral 
efficiency that can be attained using standard Gaussian 
codebooks. In fact, the capacity-achieving inputs in the 
absence of perfect-CSI become largely impractical in 



many cases (in the low-power regime, for example, 
they become unacceptably peaky) and thus the capacity 
is arguably less relevant to system designers than the 
mutual information of IID complex Gaussian inputs. 

This paper presents analytical expressions for the 
output distributions of a block Rayleigh-faded channel 
fed with IID complex Gaussian inputs. Then, a simple 
outer Monte-Carlo in conjunction with these distribu- 
tions yields a semi-analytical method that allows eval- 
uating, quickly and efficiently, the mutual information. 
The method accommodates not only scalar channels, but 
also MIMO (multiple-input multiple-output) settings. 
Altogether, this allows answering questions such as: 

• What is the impact of the perfect-CSI assumption? 

• How suboptimal are pilot-based schemes, i.e., those 
schemes that form explicit channel estimates on 
the basis of pilot observations at the receiver and 
subsequently apply these estimates to detect the 
data? 

• At which power level is the power efficiency maxi- 
mized (i.e., the energy per bit minimized)? 

Not surprisingly, the answers to these questions end up 
being a function of the fading rate and the numbers of 
antennas. With the method presented, these relationships 
can be precisely established, and some examples of this 
are provided in the paper. 

II. Channel Model 

Consider transmit and tir receive antennas, with 
> njf, and let the rij, x matrix H represent 
the discrete-time fading channel. Under block Rayleigh- 
fading, the channel entries are drawn from a zero- 
mean unit-variance complex Gaussian distribution at the 
beginning of each fading block and they then remain 
constant for the symbols within that block, where 
rib is the coherence time in symbols (or the coherence 
bandwidth if it is the frequency domain being modeled). 
This process is repeated for every block in an IID fashion. 
There is no antenna correlation and thus, within a given 
fading block, the entries of H are also independent. 

Assembling on matrices the input, the output, and 
the noise for the rib symbols within each block, their 



relationship becomes 




HX + N 



(1) 



where the input X is an tt-t x matrix while the output 
Y and the noise N are x rib matrices. Both X and 
N have IID zero-mean unit-variance complex Gaussian 
entries. With that, SNR indicates the average signal-to- 
noise ratio per receive antenna. 

Each codeword spans a large number of fading blocks, 
in the time and /or frequency domains, which endows 
ergodic quantities with operational meaning. 

Although a block-fading structure admittedly repre- 
sents a drastic simplification of reality, it does capture 
the essential nature of fading and yields results that are 
remarkably similar to those obtained with continuous- 
fading models |9|. In fact, for a rectangular Doppler 
spectrum, an exact correspondence in terms of the error 
in the estimation of H can be established between block- 
and continuous-fading models |Toj whereby 

nb = (2) 

where /m and Tg are the maximum Doppler frequency 
and the symbol period, respectively. Typically, /m = 
{v/c)fc with V the velocity and /c the carrier frequency. 
The mapping in ||2j is in terms of the minimum mean- 
square error in the estimation of H, and thus it is 
exact for pilot-based schemes that rely on such explicit 
estimation, but more broadly we take it as indicative of 
the fading rate represented by a given value of nb. 

III. Computation of the Mutual Information 

The mutual information under investigation can be 
expressed as 

1 



MY)~l){Y\X) 



(3) 



where [}(•) denotes the differential entropy operator. 

Our first result leverages the derivations in [ 11 1 to 
obtain a closed-form expression for 



Proposition 1 Let Eq{-) denote the exponential integral 
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(4) 
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Proof: See Appendix. 

Having expressed in ||3}, we now turn our 

attention to i){Y). Unfortunately, a closed-form solution 
for it seems out of reach. Denoting by p{Y) the uncon- 
ditional output distribution. 



(6) 
(7) 



HY) = -j piY)log^piY)dY 
= -E [log, p{Y)] 



Thus, if a formula for p{Y) were at hand, i}{Y) could 
be evaluated by straightforward Monte Carlo averaging. 
Such a formula is the object of the next result. 



Proposition 2 For 1 < k < rtn, define the functions 



fk{x)= exp 



I^ZSNR + ^T J (zSNR/tIt + I) 



-dz 
(8) 



Let d = [di, . . . , dn^] be the eigenvalues of y'^Y and define 
the X ript matrix Z as Zij ^ fi{dj), 1 <i,j <n^. Then 



p{Y) = 



where 



K{Y) 
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detZ 
(9) 

(10) 



Proof: See Appendix. 



In the special case of memoryless channels, i.e., for 
rib = 1/ the solution in Proposition |2] reduces to the one 
in 121. 

We also note that, due to the rotational invariance of 
H, the phase of the entries of Y carries no information 
about X. Only the magnitude of the entries of Y is 
relevant to the distribution in ||9}. 

Using ijsj and lj9j, an algorithm to compute T can be 
put forth as follows. 



Algorithm l:Evaluation of X. 



1. Pre-compute fk{x), 1 < fc < n^, on a discrete set 
X with a suitable stepsize Ax = Xk — Xk-i- 



1. Generate a sufficiently large number of input and 
output vectors according to |[T|. 



3. For each input and output pair, apply Q to 
obtain p(l'). 



4. Compute the sample average of — log2 p{Y^ via 
Monte Carlo, thereby obtaining ^{Y). 



5. Compute t)(l^|X) from |5i and apply |3i. 



The accuracy can be made as high as desired by 
averaging over more input /output sample pairs and 
by increasing the precision in Step 1. For the results 
presented in Section |Vj the number of samples and 
the value of Ax were chosen such that two decimal 



digits are correct with 90% probability. With a standard 
workstation, the entire computation process is a matter 
of seconds. 

IV. Baselines 

Before exemplifying the method described in Section 
[nil ai^d in order to use them as baselines, we introduce 
the perfect-CSI capacity and the pilot-based communi- 
cation boundaries. 

A. Capacity with Perfect CSI 

If the receiver is provided with perfect CSI, the ergodic 
capacity, in bits /s/ Hz, equals 

SNR 



C(snr) = E 



log2 det I 



HH 



(11) 



a closed form for which can be found in |[TTJ. For = 
TT-R = 1, this closed form reduces to 



C7(SNR) = ei/SNR£;i ( J-) log2 e 



V SNR 



where ) is the exponential integral 

/oo 
t-^e-^*dt. 

At high SNR, the slope of C(snr) is Sa 
bits/s/Hz/(3 dB). 



(12) 
(13) 



B. Pilot-Based Communication 

In pilot-based communication, Up pilot symbols are in- 
serted within each fading block, leaving rib — np symbols 
available for data transmission. The channel is estimated 
on the basis of the pilot observations at the receiver, and 
this estimate is subsequently utilized to detect the data. 

During the transmission of pilot symbols. 



HP + Np (14) 




where the output, Yp, and the noise, Np, are x Up 
matrices. The entries of Np are IID zero-mean unit- 
variance complex Gaussian while P is deterministic and 
must satisfy PP^ = Upl |12|. 

During the transmission of data symbols, in turn, Q 
applies only with X and N of dimension 71t x (rib — rip) 
and x (rib — rip), respectively. 

The value of rip, which can be optimized by solving 
a convex problem, depends on snr, nb and tt-t- This 
optimization, and the ensuing spectral efficiency, has 
been studied extensively, e.g., |3], |12j-|18j. In bits/ s/Hz, 
such spectral efficiency applying the channel estimate as 
if it were the true channel 1 191 equals 

c( SNR^np/n^ \ 
nb / VI + SNR (1 + np/riT)/ 

where C( ) is the perfect-CSI capacity in | [TT| and | [12| . 
A more elaborate receiver that decoded on the basis of 
the joint distribution of the channel estimate and the 



nn:l<nn<ni- 



1 - 



true channel, rather than by assuming that the channel 
estimate equals the true channel, would exceed | [15| but 
only slightly \9j. 

If the pilot and data symbols are not required to have 
the same power, i.e., if pilot power-boosting is allowed. 



then it is optimal to set 



It and to optimize only 



over the relative powers of pilots and data. This results 
in a different convex optimization, which in this case can 
be solved explicitly [12 1 leading tc[^ 



nb 



C 



nbSNR 

nt, — 2n^ 



in bits/s/Hz, and with 



nbSNR + n-j. 



nbSNR 



(16) 



(17) 



The spectral efficiency in | [T6| is superior to that in 
1 15 1. However, pilot power boosting increases the peak- 
iness of the overall signal distribution, rendering it less 
amenable to efficient amplification. 

It can be easily verified that the high-SNR slope of 
Xpb(SNR) equals 



minjnT, nn} 1 



(18) 



bits/s/Hz/(3 dB), which for n^ < n„ coincides with the 
high-SNR slope of the channel capacity without CSI at the 
receiver ||3): 



min{nT, n^<} 1 



nb 



(19) 



For > nn , | [18) can also be made to equal | [19) by using 
only a subset n^ of the transmit antennas. Thus, pilot- 
based communication need not a loss in high-SNR slope 
as long as pilot power boosting is allowed. Furthermore, 
it follows that the high-SNR slope of I(snr) also coincides 
with | [T9| and that, at high SNR, it is undesirable to 
activate nj. > n^ transmit antennas. In the next section 
we shall examine whether this holds in a wider range of 

SNR. 

V. Some Examples 

In order to calibrate the relevant values of nb, the 
following observations can be made in the context of 
emerging systems such as 3GPP LTE |20| or IEEE 802.16 
WiMAX[21|: 

• The carrier frequency fc lies between 1 and 5 GHz. 

• The symbol period is Tg w 100 /iS. However, it could 
be shortened to Tg ~ 10-20 /iS and the flat-faded 
model in Q would still apply. (For wider band- 
widths, a frequency-selective model would be re- 
quired and the computation algorithm would have 
to be modified accordingly.) 

^Eq. jl6| requires that ni, > 2 ht; variations thereof are also available 
for rib < 'iriT |12| . 



SNR(dB) 

Fig. 1. In solid, mutual information I(SNR) for n-r = Wr = 1 with 
nt, = 100. In dashed, the perfect-CSI capacity. 

• Velocities up to w « 120 Km/h are of interest, and 
for high-speed trains this extends to w « 300 Km/h. 
With all of this taken into account, nb can take values 
ranging from just over unity to several hundred. As the 
following example evidences, for large rib the perfect- 
CSI capacity accurately represents the achievable mutual 
information. 

Example 1 Let nx = jir = 1 and let nt, = 100. Shown in 
Fig.^are the mutual information and the perfect-CSI capacity 
as function o/snr. 

For the remainder of this section, we shall focus on 
scenarios where rib is small. Specifically, we shall use 
rib = 10 and 7ib = 4. These will tend to correspond 
to vehicular and high-speed-train velocities, possibly in 
conjunction with relatively long symbol periods and 
relatively high carrier frequencies. 

Example 2 Let = 1 and let = 10. Shown in 

Fig. |2] is the mutual information as function of snr. Also 
shown are the spectral efficiencies achieved by pilot-based 
communication, with and without pilot power boosting, and 
the perfect-CSI capacity. 

We observe that a hefty share of the perfect-CSI capac- 
ity is achieved at high snr in this scenario, although this 
diminishes markedly with the SNR. We further observe 
that, by optimizing the pilot overhead or the pilot power 
boost at every snr, pilot-based communication schemes 
can perform remarkably close to the fundamental com- 
munication limit of IID complex Gaussian inputs in this 
scenario. 
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Fig. 2. In solid, mutual information I(SNR) for rtT = nn. = 1 with 
Tib = 10. Also in solid, spectral efficiencies achieved by pilot-based 
communication, with and without pilot power boosting. In dashed, 
the perfect-CSI capacity. 




SNR(dB) 

Fig. 3. In solid, mutual information I(SNR) for rtT = riR = 1 with 
nt, = 4. Also in solid, spectral efficiencies achieved by pilot-based 
communication, with and without pilot power boosting. In dashed, 
the perfect-CSI capacity. 
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Fig. 4. In solid, mutual information !r(SNR) for n-r = n^. = 1 and for 
riT = 2, riR = 1, with nt) = 10. In dashed, the respective perfect-CSI 
capacities. 



Fig. 5. In solid, mutual information I(SNR) for tit = = 2, with 
nb = 10 and with nt = 4. In dashed, the corresponding perfect-CSI 
capacity. 



Example 3 Fig. |3] re-evaluates Example |2] zvith nt, — 4. 

In this case, the relative gap between the perfect- 
CSI capacity and the achievable mutual information is 
very substantial. (At dB, less than half the perfect- 
CSI capacity can actually be achieved by IID complex 
Gaussian inputs.) The spectral efficiency of pilot-based 
schemes is similarly affected. Remarkably though, the 
performance of these schemes relative to the mutual 
information limit is essentially unaffected. 

Example 4 Let = 1 and let nt = 10. Shown in Fig. |4] 
is the mutual information as function of snr with = 1 
and with 11^ = 2. Also shown are the respective perfect-CSI 
capacities. 

A well-known feature of the perfect-CSI capacity is 
that it always increases with additional antennas, be it 
at the transmitter or at the receiver. Example |4] reflects 
this increase. However, the considerations in Section |IV| 
inspired by |[3|, |12|, suggest that in reality activating 
> nn antennas would be detrimental at high snr. 
Example |4] confirms that this is indeed the case, not only 
at high SNR but at every snr of interest, when the level of 
mobility is sufficiently high. (For this particular example, 
up to around ~ 40.) 

Example 5 Let 2. Shown in Fig.^is the mutual 

information as function o/snr with n^, = 10 and with n^, = 4. 
Also shown is the corresponding perfect-CSI capacity. 

Comparing Example |5] with Examples |2] and |3| no- 
tice how, at each level of mobility, MIMO transmission 



suffers a more drastic loss relative to the perfect-CSI 
capacity. Note that, with nt, = 4, the mutual information 
for TT-T = = 2 is larger thab for ^ n^^l (Example 
|3j. Although Example 4] illustrated that an additional 
transmit antenna should be activated only for reasonably 
long rib, this shows that an additional transmit-receive 
pair should be activated even for short rib. 

VI. Conclusion 

We have presented a method (partly analytical, 
partly Monte Carlo) to compute the mutual information 
achieved by IID complex Gaussian inputs on block 
Rayleigh-faded channels, both scalar and MIMO. This 
mutual information is highly relevant as it represents 
the highest spectral efficiency attainable with standard 
Gaussian codebooks. 

In prior work |22|, some of the authors derived a 
lower bound to this mutual information (allowing but 
not requiring pilot symbols). Specialized to the case of 
no pilots, that bound is 



I(snr) > C(snr) 



log2 1 + SNR 

nb V nT 



(20) 



The method presented in this paper also allows verifying 
the accuracy of this lower bound. 

In addition, the method may be of interest to other 
multivariate problems involving combinations of multi- 
plicative and additive Gaussian noise, either with respect 
to the mutual information or to the constituting differ- 
ential entropies. 



A software routine that implements the described 
method in Matlab can be downloaded at 

www . ece . umn . edu/ "nihar /MI_MIMO_f inal . m 

Appendix 

A. Preliminaries 

For subsequent use, we present three relevant identi- 
ties. The first one, easily verified, is 

exp{-x^A + xB}dx^expl—j^j. (21) 

The second one is an integral due to Itzykson and 
Zuber |23|. Given an M x M diagonal matrix Z with 
diagonal elements z, an arbitrary M x M matrix D with 
eigenvalues d, and an M x M isotropically distributed 
unitary random matrix U, 



. M 



(m - 1)! detE{d,z) 
detV{d) detV{z) 



(22) 

where the (i,j)th entry of the M x M matrix E{d,Z) 
equals exp{(iiZj} while V{-) denotes a Vandermonde 
matrix, i.e., such that 

detV{d) = Yl (dj - di)- (23) 

The final identity was proved in fl^ by Chiani, Win 
and Zanella. Given two arbitrary M x AI matrices 'S'(x) 
and ^{x) with (i, j)th entries ^'^(xj) and ^i{xj), respec- 
tively, and an arbitrary function ^{■), 

M 



det*(a;)det*(a;) J]^ C(a;m)da; 



det 




^,{x)^,ix)ax)dx\ 



(24) 



i,j = l...M . 



where the multiple integral is over the domain Pord = 
{b > xi > X2 > ■ ■ ■ > xm > a}- 

B. Proof of Proposition^ 

Conditioned on X, the output Y is complex Gaussian. 
Furthermore, the rows of Y are IID conditioned on X. 
Hence, to obtain ()(Y'|X) it suffices to evaluate its value 
for an arbitrary row of Y and then scale it by the number 
of rows, i.e., by n„. 

Let y be an arbitrary row of Y. The conditional co- 
variance of the rib-dimensional column vector equals 

(25) 



E [y^y\X] = I 

and thus 

f,(y|X) = f,(yt|X) 



= E 



log2 (7re)"b det / 



SNR 



-X^X 



(26) 
(27) 



with expectation over the distribution of X. Factoring 
out the term nblog2(7re), what remains coincides with 
the perfect-CSI capacity of a MIMO channel, only with 
the role of the channel played by X. Since the entries of 
X are IID complex Gaussian with zero mean and imit 
variance, we may directly apply the closed form in plj 
with appropriate dimensioning. Scaling the end result 
by Hr, we convert l){y\X) into ()(y|X) as desired. 

C. Proof of Proposition |2] 

Define 7 = SNr/tit. Then, denoting by Xt the ith 
column of X, 



p{Y)=Eh 



I p{Y\H,X)piX)dX 



1 



X exp 



E 



H 



(28) 

]j[oxp{-\\y,-Hx,r} 

■I- 1 

(29) 



dxt 



Using the singular-value decomposition H = UHV^ , 
absorbing V into X through the variable substitution 
Xt = V^xt, and assembling the diagonal entries of SS^ 
into A = [Ai, . . 



■ I Ajii,], 



(7r7)"Tnb7r"R"b 



4 — 1 



dxt 



X exp|2Re{yjL''Sa;f}| exp 

(7r7)"T"b7r"R"b 
X exp ^^2Re{ylukT,kXt.k} - |it,fcP + ^ 



(30) 



n n 



Applying <[2l| to each variable xt^k in l[30) gives 



(31) 



p{Y)-. 



exp{-||y||2} 



7r"ri"b 



E 



H 



t=l k=l 



..(Re{yluk} 



X exp ■ 



Xk (lm{yluk} 



1 



,Afc7 + l 



(32) 



exp{~||r|p} 
7r"R"b 

1 

Afc7 + 1 



E 



H 



Lfc=l 



XkjulYY^Uk 

(Afc7 + 1) 



(33) 



Let A{X) be a diagonal matrix with fcth diagonal entry 
flfc = Xkl/{XkJ + 1). It is known that U, S, and V in 
the singular-value decomposition of H are independent 



random matrices and that both U and V are isotropically 
distributed. Therefore, we can express p3) as 



1 



j p(Lr)exp|Tr{A(A)C/Vy^C/}}d[/ 



dA. 

(34) 



The r.h.s. of 134 1 is precisly the setup in 1 22 1. Let a(A) = 
[fli; . . . , a„p.] contain the diagonal elements of A{X) and 
let d contain the eigenvalues of YYK Then, 

nfc^i(fe^l)!e-ll^ll^ f detE{a{X),d) 
P(Y)- ,„...,.^_„.„. y ^(^^ detV(a(A)) 



detV(d) 7r"«"b 

xnf^^) dA 



fc=i 



Afc7 + 1 



(35) 



The density distribution of the (ordered) eigenvalues 
in A equals 



p{x) - dctV(A) n 



fc=l 



(36) 



Moreover, 

[detF(a(A))]-i = n 



n 

k>i 



Afc7 



Af7 



Aa-7 + 1 7 + 1 

1 (Afc7 + 1)(A,7+1) 
Afe — Af 



1 nfe>£(Afe7+l)(A«7 + l) 



-y("R-«R) dety(A) 

1 miA^ki + i)"---' 



ry{nl-nn) dety(A) 

Plugging ||36) and ^ into l|35) yields 

) . ^-pM'^"^) 

dety(<i)7K-"R)7r"R"bJ]fc^!i(nT-fc)! 

— Afc^KT— "R 



(37) 



detF(A) 



det£;(a(A),d) TT ^^f— ^ dA 



exp{-|irf} 



dety (d) 7r"i^"b J];;^^^ (n^ - fc)! 



dety(A/7) 



det£;(a(A), d) n (;,^; + i)n,+i^„R dA- (38) 



The multiple integral in | [38| is an instance of | [24| . 
Simply identify 



$(A) = dety(A/7) 



*(A) = det£;(a(A),d) 



-X „nT— "R 



(x7 + l)»b+i-"R 



(39) 



(40) 



(41) 



to obtain 

p{Y) = 
where 



exp 



{^\\Yf} 



detZ 



7r«R»b dctV{d) UlliiriT - k)! 



(42) 



Zii = I (xHY ^exp<c?,- — '-^—x\- -T — dx. 

io I ^2^7 + 1 J (a;7 + l)"b+i-"H 

(43) 
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